m D-A177  £29  REAL-TIME  IMPLEMENTATION  OF  NONLINEAR  OPTICAL  '  1 

PROCESSING  FUNCTIONSCU)  HUGHES  RESEARCH  LAOS  MALIBU  CA 
B  H  SOFFER  ET  AL  SO  SEP  0£  AFOSR-TR-87-8219 
UNCLASSIFIED  F4962B-84-C-8096  F/G  20/£  NL 


oum 

5SE 

AFOSR-TR.  8  7-0219 


i  REAL-TIME  IMPLEMENTATION  OF  NONLINEAR 


OPTICAL  PROCESSING  FUNCTIONS 


*  f  .y  ^ 

•  '  '> 


An>  .. 


B.H.  Softer,  Y.  Owechko  and  E.  Marom 


-  ’  ■I'rr  •% 

,  •  r.  .  - 


Hughes  Research  Laboratories 
301 1  Malibu  Canyon  Road 
Malibu,  CA  90265 


v’r/  / 


•  ?  .. 

■  . 


1‘* 


*****.. 


September  1986 


F49620— 84— C— 0096 


Annual  Technical  Report 
1  September  1985  through  31  August  1986 


This  manuscript  is  submitted  for  publication  with  the  understanding 
that  the  United  States  Government  is  authorized  to  reproduce  and  dis¬ 
tribute  reprints  for  governmental  purposes. 


AIR  FORCE  OFFICE  OF  SCIENTIFIC  RESEARCH 


Bolling  Air  Force  Base 

v 

t  Washington,  DC  20332 


$ 


DTIC 

ELECTE 
FEB3  7t987 


Vi 


8T 


26  654 


O  -u"  ^ 


5 KflWWSW 


UNCLASSIFIED 


REPORT  DOCUMENTATION  PAGE 


la  REPORT  SECURITY  ClASSiFiCAT  ION 

Unclassified 

lb.  RESTRICTIVE  MARKINGS 

2*.  SECURITY  CLASSIFICATION  authority 

3.  DISTRIBUTION- A  VAi  LABI  LlTY  OF  REPORT 

This  document  is  furnished  under  the  referenced  contract.  It 
contains  information  which  discloses  #n  invention  in  which  the 
Government  has  in  interest  (see  psges  69  through  67).  This 
information  most  be  withheld  from  release  to  the  public  pursuant 
to  36  USC  296  to  enable  the  filing  of  a  patent  application. 

2b.  DECLASSlFlCATlON  OOWNGRAOiNG  SCHEDULE 

4  PERFORMING  ORGANIZATION  REPORT  NUMBE  R  iS ) 

5.  MONITORING  ORGANIZATION  REPORT  NUMBER  (SI 

fcFOSR-m.  8  7-0219 

6a  NAME  OF  PERFORMING  ORGANIZATION  60.  office  symbol 

Hughes  Research  Laboratories  " 1 

7*.  NAME  OF  MONITORING  ORGANIZATION 

Air  Force  Office  of  Scientific  Research 

v”  - - - - -  - 

J3011  Malibu  Canyon  Road 
Malibu,  CA  90265 


7b.  ADDRESS  iCit y.  State  and  ZIP  Code) 


Bolling  Air  Force  Base 
Washington,  DC  20332 


2&<d 

fc 


B.  NAME  OF  FUNOlNG/SPONSORlNG 
ORGANIZATION 

)  <  *'  «•'(  i  /  f-i 


80.  OFFICE  SYMBOL  9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 
(If  applicable ) 


)  i>  %  <-i  )  (  M 

Sc.  ADDRESS  (City.  State  and  ZIP  Codet 


4/  cr 


Y)  ■£  S,  3  ,t> 


^  ,1  *  c 


PROGRAM 
E  LEMENT  NO 


I  1 1  TITLE  '/nciud*  Scarify  C/a«ificonon  > 

Ireal-time  implementation  of  nonlinear  OPTICAL  processing 


£  i/o 2  r 


ND'NG  NOS 

PROJECT  | 

TASK 

NO  , 

NO 

230'  \ 

0/ 

WORK  UNIT 
NO 


12.  PERSONAL  AUTMOR(S) 


13*.  TYPE  OF  REPORT 

Annual  Report 


B.H.  Softer 


13b.  Time  covereo 
FROM  1  Sap t  198S  to  31  A ug  19 


14.  OATE  OF  REPORT  Vr .  vj0  .  Day i 

1986  Sept  30 


15  PACE  COUNT 


16  SUPPLEMENTARY  NOTATION 

RMMI-Ch  sponsored  by  the  AFOSR  (AFSC)  ,  und«r  Contr»ct  F49620-84-C-0096 .  Th»  U.S.  Gov»rnm*nt 
is  6uthor i zwd  to  raproduca  and  distribute  reprints  for  govarnmanti I  purposas  notwithstanding 
•ny  copyright  notation  hereon. 


COSATI CODES 


18  SUBJECT  TERMS  ( Continue  on  reuerse  if  necessary  and  identify  by  block  number) 

Optical  signal  processing,  optical  data  processing,  signal 
processing,  data  processing,  liquid  crystal  devices, 
associative  memorv,  neural  networks 


19  ABSTRACT  i Continue  on  reverie  if  neceuary  and  identify  by  block  numb*r> 

Optical  data  processing  has  not  yet  achieved  its  potential  of  increased  capacity  and 
speed  compared  with  conventional  electronic  techniques,  primarily  for  lack  of  a  practical 
real-time  image  modulator,  and  because  optical  techniques  have  been  almost  exclusively 
limited  to  linear  operations.  The  continuing  research  outlined  in  this  report  attacks 
these  issues  by  studying  the  implementation  of  real-time  nonlinear  para  I  I  el -process! ng 
techniques.  The  various  implementations  studied  in  this  program  for  the  most  part 
employed  real-time  liquid-crystal  light  valves  developed  and  specially  modified  for  these 
tasks  by  Hughes  Research  Laboratories.  One  approach  we  investigated  early  in  the  program 
was  to  modify  and  characterize  the  twisted -nematic  liquid-crystal  (LC)  devices,  and  then 
use  them  in  a  coherent  optical  data-process i ng  apparatus  using  special  half-tone  screen 
masks,  custom  designed  for  special  functions  at  USC  in  a  cooperative  effort  under  an  AFOSR 
grant.  Using  the  half-tone  mask  technique,  we  demonstrated  logarithmic  nonlinear 
transformation,  permitting  us  to  simplify  multiplicative  images  and  perform  homomorphic 


120  DISTRIBUTION  availability  OF  abstract 


v,  •»*  •*„ 

UNCLASSl  FI  ED/UN  LI  MITE  O  _  SAME  AS  RPT  25  OTIC  USERS  D 

■4  •  •  ft  _ _ 

«  "I  ■  ■  ■  I  I-  ■ 

22»  NAME  OF  RESPONSIBLE  individual 

"►V  -Br+fr'SbTfer  (_'  L  C  •  •  I  >'  > 

•+  *■  ■ 

>  -•  DD  FORM  1473,  83  APR  ED'TiON  of  1  JAN  73  IS  OBSOLETE 

**.  •*.  y>tf a .  »*.  •’(  * .  *■,  .  •r,  •'  . 


21  ABSTRACT  SECURITY  CLASSIFICATION 

UNCLASSIFIED 


22b  TELEPHONE  NUMBE  H 
i Include  \rva  0><Jc 

(213)-  317-  if 3 6  y 


1 22c  OFFICE  S  YMBO  L 


UNCLASSIFIED _ 

<  ’  '  L^ASS.F  CAT  ON  OP  7  m  is  PAGE 


CwAI  .-A  «>/■  iaA  L'.  “jl  '51*J|  V-  •  J»  *  J.  - 


SECURITY  CLASSIFICATION  OF  THIS  FACE 


filtering.  Furthermore,  a  novel  ana log-to-d i g i ta I  converter  based  on  a  modified  pure 
birefringence  LCLV  was  developed.  It  can  perform  real-time  parallel  processing  using 
incoherent  light,  and  it  promises  high  data  throughput  rates.  In  addition,  a  novel  device 
that  converts  light  intensity  variations  to  LC  grating  period  variations  was  fabricated, 
and  is  currently  being  evaluated  and  improved.  This  device  permits  nonlinear  functions  to 
be  implemented  directly  without  the  need  for  specially  made  half-tone  masks.  Besides 
nonlinear  analog  functions,  this  variable  grating  mode  (VGM)  device  has  demonstrated  the 
capability  of  performing  digital  logic.  Logical  functions  are  merely  special  cases  of 
non  I i near i ti es .  A  novel  technique  for  spoiling  the  long-range  order  of  the  grating 
domains  has  made  a  remarkable  improvement  in  VGM  response  time  from  seconds  to  tens  of 
milliseconds.  A  theoretical  and  experimental  study  of  the  behavior  of  the  liquid  crystal 
molecules  in  the  VGM  effect  has  yielded  much  information  concerning  molecular  orientation 
and  thresholds.  A  study  of  the  dynamics  of  grating  formation  and  relaxation  was  carried 
out  in  order  to  improve  the  VGM  response  time.  In  cooperation  with  USC,  the  final  studies 
of  the  physical  basis  of  the  variable  grating  mode  (VGM)  effect  were  brought  to  a  close 
this  year. 

We  completed  research  on  a  novel  optical  method  for  dividing  two  images  or  arrays  of 
data  in  real-time.  There  are  no  other  reported  methods  of  optical  division!  Related  to 
this,  two  further  inventions  were  conceived,  optical  matrix  multiplier  and  an  all  optical 
matrix  inverter.  The  matrix  inverter  is  the  first  invention  of  a  fully  optical  system  to 
perform  this  important  function  with  many  system  applications.  Separately  work  has  been 
initiated  in  cooperation  with  Dr.  A.  Tanguay  at  USC  on  the  general  limits  and 
optimizations  of  optical  systems.  Another  task  pursued  was  the  conception  and 
experimental  demonstration  of  a  new  technique  for  subtracting  images  in  real-time  using  a 
single  LCLV.  This  simplication  of  earlier  subtraction  schemes  should  prove  useful  in  a 
variety  of  fields  including  surveillance,  robotics  and  inspection  and  control  of 
manufacturing  processes. 

During  this  program  period  we  continued  in  a  new  and  very  important  direction  begun  at 
the  end  of  the  last  period.  We  are  developing  an  all  optical  associative  memory  using 
holographic  storage  of  the  data  base  and  phase  conjugate  mirrors  to  provide  feedback, 
nonlinear  thresholding  and  gain.  Associative  memories  can,  for  example,  recall  the 
closest  memory  to  a  given  partial,  noisy  or  corrupted  input  addressed  to  the  system.  They 
can,  among  other  things,  classify  inputs  and  also  heteroassociate  one  image  with  another. 
We  have  demonstrated  grey-level  image  recall  and  image  recall  with  multiple  stored  images 
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Alternative  concepts  and  devices  that  exhibit,  like  VGM,  the  fundamentally  new  and 
important  property  of  converting  intensity  variations  into  positional  variations,  but 
which  potentially  are  faster  yet,  were  further  investigated  in  this  period. 
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SECTION  1 


INTRODUCTION 

For  the  past  two  decades  optical  data  processing  (ODP)  has 
promised  a  vast  increase  in  processing  capacity  and  speed  over 
conventional  electronic  techniques.  This  promise  has  never  been 
fulfilled  for  several  reasons,  most  notably  because  of  the  lack 
of  a  practical  real-time  image  modulator,  or  light  valve,  and 
because  optical  techniques  were  almost  exclusively  limited  to 
linear  operations.  These  restrictions  have  been  removed  by  the 
development  of  the  1 i qui d- cry s tal  light  valve  (LCLV)  by  Hughes 
Research  Laboratories  (HRL)  ,  and  by  nonlinear  paral 1  el -processing 
techniques  developed  by  the  University  of  Southern  California 
(USC) .  Thus,  it  is  important  to  determine  how  successfully 
nonlinear  paral 1  el -process ing  techniques  can  be  implemented  in 
real  time  with  the  various  LCLVs .  In  addition,  other  new  optical 
technologies,  highly  developed  at  HRL,  such  as  four-wave  mixing 
and  phase  conjugation  have  inspired  a  novel  research  direction 
for  this  program  in  the  field  of  optical  associative  memories  and 
neural  networks  as  models  for  computing.  Here  the  phase 
conjugation  provides  the  desired  nonl inear i ti es . 

The  implementation  and  evaluation  of  these  techniques  have  a 
direct  relationship  to  current  Air  Force  technology.  Pertinent 
Air  Force  interests  include  multidimensional  real-time  signal  and 
image  processing  with  varied  applications,  including  nonlinear 
filtering  for  trajectory  control  and  guidance,  "smart"  sensing, 
picture  processing,  and  bandwidth  compression,  image  and  target 
recognition  and  symbolic  processing.  These  technologies  could 
benefit  substantially  from  the  increased  processing  capacity  and 
speed  that  this  research  may  yield. 

In  this  section  we  describe  our  optical  methods  and  the 
motivation  for  studying  a  real-time  application  of  those 
techniques.  In  Section  2  we  describe  the  progress  made  during 
the  current  program  year . 


Until  now,  specified  nonlinear  operations  have  been  performed 
only  with  great  difficulty.  Coherent  optical  techniques  are 
essentially  restricted  to  linear  operations.  Digital  processing 
to  produce  nonlinear  transformations  is  possible,  but  only  in  a 
slow,  serial  fashion.  Certain  nonlinearities  can  be  produced  by 
special  photographic  techniques,  but  the  speed,  accuracy, 
reproducibility,  and  dynamic  range  of  these  techniques  are 
1 imi ted . 

We  have  been  pursuing  different  tasks  to  attempt  to  overcome 
these  shortcomings.  The  first  made  use  of  special  half-tone 
screens  to  modulate  the  input  image  in  conjunction  with  coherent 
optical  processing.  This  technique  had  made  it  possible  to 
implement  nonlinear  effects  when  higher  orders  of  the  half-tone 
diffraction  pattern  are  examined  by  spatial  filtering.  Sawchuk 
and  Dashiell  of  USC  have  shown,  using  specially  fabricated  half¬ 
tone  screens,  how  a  very  wide  class  of  two-dimensional  point 
nonlinear  functions  can  be  implemented  with  a  large  dynamic  range 
as  a  function  of  screen  design  and  diffraction  order.  The 
nonlinearities  can  be  continuous  or  discontinuous.  Operations 
such  as  taking  logarithms,  exponentiation,  level  slicing, 
intensity  bandstopping,  and  histogram  equalization  can  be 
performed.  We  have  expanded  the  half-tone  screen  technique  by 
substituting  a  real-time  photo-modulated  LCLV  for  the  static 
photographic  recording  medium,  and  we  have  successfully 
demonstrated  a  logarithmic  nonlinear  transformation  using  this 
technique.  This  transformation  is  useful  for  homomorphic- 
filtering  applications  as  we  have  demonstrated.  In  cooperation 
with  USC,  we  have  also  studied  the  performance  potentials  and 
limitations  of  this  implementation  and  how  to  iteratively  modify 
and  improve  the  LCLV  and  half-tone  masks. 

A  second  general  method  which  we  have  studied  also  overcomes 
the  limitations  of  serial  or  photographic  processing;  it  employs, 
in  one  realization,  a  liquid-crystal  effect  variable  grating  mode 
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(VGM)  that  can,  when  incorporated  into  a  new  type  of 
photoconductive  structure,  automatically  map  image  intensity 
variations  into  positions  in  Fourier  space.  Filtering  and 
reconstructing  can  then  yield  many  desired  nonlinear 
transformations  of  the  image  without  the  need  for  specially 
constructed  half-tone  masks.  A  new  additional  parameter,  the 
intensity,  has  thus  been  made  available  for  optical  image  and 
data  processing.  Recognizing  that  logical  operations  are  merely 
a  special  case  of  nonlinear  operations,  we  have  demonstrated  a 
unique  and  highly  advantageous  optical  computing  scheme  using  the 
VGM  technique.  The  VGM  device  is  still  in  an  early  stage  of 
development  and  much  material  research  and  device  development 
would  still  be  needed  to  make  it  into  a  practical,  real-time, 
reliable  optical  image  modulator.  We  have  discovered  and 
investigated  a  novel  technique  for  spoiling  the  long-range  order 
in  the  VGM  domains  by  modifying  the  substrates  in  order  to  effect 
a  remarkable  improvement  in  the  temporal  response  of  the  device 
from  the  previous  values  of  many  seconds  to  the  present  value  of 
tens  of  milliseconds.  Empirical  and  theoretical  studies  of  the 
basic  VGM  effect  have  been  made,  including  the  study  of  the 
detailed  optical  polarization  properties  of  the  VGM  optical 
diffraction  patterns  and  the  minimization  of  free  energy 
calculations,  with  the  goal  of  completing  the  modeling  of  the 
molecular  configuration  of  the  liquid  crystal  system.  The 
results  of  these  studies  may  result  in  the  molecular  engineering 
of  liquid  crystal  mixtures  with  more  rapid  temporal  response. 

The  studies  of  the  physical  nature  of  the  VGM  effect  are 
essentially  done  and  were  completed  in  this  program  period  in 
collaboration  with  USC .  We  are  also  studying  alternative 
practical  realizations  of  intensity  to  positional  mapping  which 
may  overcome  some  of  the  shortcomings  of  VGM,  yet  retain  the 
great  flexibility  offered  by  intens i ty-to-pos i tional  coding. 

We  also  had  devised  in  the  last  period  a  method  using  LCLVs 
to  enable,  for  the  first  time,  the  entirely  optical  analog 
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division  of  two  arrays  of  numbers  or  images,  pixel  by  pixel  in 
real-time.  This  work  was  brought  to  conclusion  with  a  successful 
experimental  demonstration.  In  addition  a  technique  to  perform 
real  time  substraction  using  a  single  spatial  light  modulator  was 
also  developed. 

We  began  in  the  last  period  an  important  new  direction  for 
the  program,  the  all  optical  associative  memory.  This  work  was 
emphasized  in  the  current  reporting  period. 


SECTION  2 


PROGRESS  DURING  CURRENT  PROGRAM  PERIOD 

During  this  program  period  we  pursued  several  new  tasks. 

Work  was  initiated  in  cooperation  with  Dr.  A.  Tanguay  at  USC  on 
the  general  limits  and  optimizations  of  optical  systems.  Also  in 
cooperation  with  USC,  the  final  studies  of  the  physical  basis  of 
the  variable  grating  mode  (VGM)  effect  are  being  brought  to  a 
close.  Alternative  spatial  frequency  to  positional  mapping 
schemes,  based  on  gradient  index  beam  deflection,  were  also 
investigated  in  this  period.  A  new  and  very  important  direction 
for  the  program  was  taken  with  the  inception  of  work  on  an  all 
optical  associative  memory  using  holographic  storage  of  the  data 
base  and  phase  conjugate  mirrors  to  provide  feedback  nonlinear 
thresholding  and  gain.  Associative  memories  can,  for  example, 
recall  the  closest  memory  to  a  given  partial,  noisy  or  corrupted 
input  addressed  to  the  system.  They  can,  among  other  things, 
classify  inputs  and  also  heteroassociate  one  image  with  another. 

A.  OPTICAL  ASSOCIATIVE  MEMORY 

In  this  program  period  we  have  developed  a  new  task:  the 
research  and  development  of  an  all  optical  associative  memory. 
Partial  noisy  or  incomplete  information  addressing  the 
associative  memory  system  will  retrieve  the  closest  stored 
complete  image.  Our  novel  approach  is  in  part  to  store  multiple 
3-D  images  or  data  bases  globally  in  the  holograms.  Each  of  the 
multiplexed  images  is  stored  with  its  own  angularly  coded 
reference  beam  in  the  recording  phase.  In  retrieving  the 
information,  retroref 1 ection ,  nonlinear  thresholding,  feedback, 
and  gain  are  achieved  with  phase  conjugate  mirrors.  A  technical 
discussion  of  our  concept  and  the  results  of  our  preliminary 
experiments  are  described  in  the  following  reprint  of  a  recent 
Optics  Letters  paper. 
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We  describe  an  all-optical  associative  memory  system  that  uses  a  holographic  data  base.  Phase-conjugate  mirrors 
are  used  to  provide  optical  feedback,  thresholding,  and  gain  Analysis  and  preliminary  experiments  are  discussed. 


The  principle  of  information  retrieval  by  association 
has  been  suggested  as  a  basis  for  parallel  computing 
and  as  the  process  by  which  human  memory  func¬ 
tions.1  Various  associative  processors  have  been  pro¬ 
posed  that  use  electronic  or  optical  means.  Optical 
schemes,11"  in  particular  those  based  on  holographic 
principles,1 6  7  are  well  suited  to  associative  processing 
because  of  their  high  parallelism  and  information 
throughput.  Previous  workers®  demonstrated  that 
holographically  stored  images  can  be  recalled  by  using 
relatively  complicated  reference  images  but  did  not 
utilize  nonlinear  feedback  to  reduce  the  large  cross 
talk  that  results  when  multiple  objects  are  stored  and 
a  partial  or  distorted  input  is  used  for  retrieval.  These 
earlier  approaches  were  limited  in  their  ability  to  re¬ 
construct  the  output  object  faithfully  from  a  partial 
input. 

Recently  a  matrix-based  associative  memory  model 
using  feedback  and  nonlinear  thresholding  was  de¬ 
scribed.19  The  concept  has  been  demonstrated  for 
one-dimensional  data  by  digital  computation  as  well 
as  by  optical  means.4  Storage  of  two-dimensional 
data  (images)  would  result  in  a  four-dimensional  asso¬ 
ciation  matrix,  making  the  problem  much  more  diffi¬ 
cult  to  handle  electronically  or  optically. 

It  is  the  purpose  of  this  Letter  to  present  a  parallel 
optical  associative  memory  system  with  feedback  that 
is  implemented  with  holograms  and  nonlinear  optical 
elements.  The  global  memory,  a  hologram,  is  capable 
of  storing  multiple  three-dimensional  objects,  thus 
overcoming  one  of  the  limitations  of  the  matrix-based 
approach.  The  nonlinear  interaction  is  achieved  by 
using  phase -conjugate  mirrors  (PCM's)  to  provide  the 
regenerative  feedback,  thresholding,  and  amplifica¬ 
tion  mechanism. 

The  formation  of  a  hologram  involves  the  exposure 
of  a  light-sensitive  medium  with  two  coherent  wave 
amplitudes  A(u,  v)  and  B(u,  i )  generated  by  two  ob¬ 
jects  a  and  6.  When  the  hologram  is  irradiated  by  a 
complex  wave  front  A(u,  v).  which  is  a  distorted  or 
incomplete  version  of  Aiu.  c •),  the  amplitude  transmit¬ 
ted  by  the  developed  hologram  is  proportional  to 

A  |  A  +  B  |  -  =  A<  |  A  |  -  +  |  B  |-)  +  AaB  +  AAB,  ( 1 ) 


where  a  bar  (e.g..  A)  indicates  the  complex  conjugate 
of  the  unbarred  function. 

The  last  term  of  this  expression  is  essentially  the 
convolution  of  the  object  b  with  the  correlation  of  a 
and  a.  For  most  natural  objects  there  is  sufficient 
phase  variation  so  that  if  a  is  identical,  or  close,  to  a, 
their  correlation  provides  a  sharp  peak  and  b  is  faith¬ 
fully  reconstructed. 

Multiple  objects  b,  can  be  stored  in  a  hologram,  each 
associated  with  a  different  reference  wave  a,.  This  by 
itself  acts  as  a  linear  associative  memory,  so  that  a 
distorted  a,  can  be  represented  as  a  weighted  superpo¬ 
sition  of  several  a  „  without  discrimination.--3  To  dis¬ 
play  the  image  6,  most  closely  associated  with  d„  one 
needs  to  eliminate  all  other  images,  retaining  onlv 

A,A,B,. 

A  common  use  of  associative  memories  is  one  in 
which,  given  a  ,  one  is  interested  in  the  determination 
of  a,,  the  stored  undistorted  record,  rather  than  in  its 
mate  b,.  The  mate,  however,  is  necessary  to  help  iden¬ 
tify  the  record  ;;  thus,  if  the  last  term  in  Eq.  ( 1 )  is  used 
to  readdress  the  hologram,  one  obtains 

AAB  |  A  +  B  |  -  =  AABt  |A|-  +  |BJ-) 

+  AABAB  -I-  AABAB 
=  AAB(|A|- +  |B|-’)  +  <AA)|B|-’A 
+  AAJB-.  (2) 

Note  that  for  most  objects  a  and  b ,  their  phase 
variations  will  result  in  uniform  intensity  distribu¬ 
tions  |  A  |  -  and  |  B  | J  at  the  hologram.  These  terms  will 
only  slightly  alter  the  transmitted  amplitude,  leaving 
its  phase  almost  unaffected.  (If  A  =  A  the  phase  is 
perfectly  regenerated.)  As  a  result  the  underlined 
term  represents  a  close  restoration  of  the  field  distri¬ 
bution  A,  which  in  turn  reconstructs  object  a.  It 
should  be  noted  that  this  discussion  treats  a  single 
image  recorded  on  a  hologram,  analyzed  in  a  linear- 
approximation  model.  If  multiple  images  were  pres¬ 
ent.  the  analysis  would  show  that  there  is  poor  dis¬ 
crimination  between  the  desired  image  and  the  cross 
terms.  The  addition  of  nonlinear  elements  that  pro¬ 
vide  thresholding  and  feedback  improves  the  discrimi¬ 
nation,  as  described  below. 
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Psaltis  and  Farhat4  in  a  recent  paper  briefly  de¬ 
scribed  an  associative  memory  scheme  based  on  a  two- 
hologram  configuration.  The  thresholding  element  is 
in  the  image  portion  of  the  loop,  similar  to  HopfieldV 
approach. 

In  our  system  we  combine  the  principles  of  holo¬ 
graphic  memories  and  PCM’s  to  implement  a  novel 
nonlinear  holographic  associative  memory.  Only  a 
single  hologram  is  needed  in  this  configuration,  and  it 
is  simultaneously  addressed  by  the  object  as  well  as  by 
the  conjugate  reference  beams,  the  latter  acting  as  the 
key  that  unlocks  the  associated  information.  PCM’s 
are  used  for  beam  retroreflection  as  well  as  for  gain 
and  thresholding.  This  provides  the  necessary  non¬ 
linearity,  emphasizing  only  the  strongly  correlated  sig¬ 
nals. 

The  memory  consists  of  a  hologram  in  which  a 
stored  object,  a,,  is  written  using  a  plane-wave  refer¬ 
ence  b„  as  illustrated  in  Fig.  1.  The  two  legs  of  the 
memory  consist  of  a  reference  leg  and  an  object  leg, 
each  with  its  respective  PCM.  A  partial  or  distorted 
input  object  a,  generates  a  distorted  reference  beam  b,. 
The  distorted  reference  b,  is  focused  by  the  lens  onto 
PCM  1.  PCM  1  is  a  thresholding  conjugator,  e.g.,  a 
stimulated  Brillouin  scattering  cell  or  a  self-pumped 
photorefractor.  The  desired  plane-wave  reference 
component  of  5,  forms  a  bright  spot  on  PCM  1  (PCM  1 
is  in  the  Fourier  plane  of  the  lens).  PCM  1  will  select 
this  bright  region  (thresholding),  conjugate  it,  and  re¬ 
flect  it  back  toward  the  hologram  as  a  partially  re¬ 
stored  reference  5,.  This  partially  restored  reference 
then  illuminates  the  hologram  and  generates  a  partial¬ 
ly  restored  object  a„  which  is  conjugated  and  reflected 
by  PCM  2  back  to  the  hologram  (without  threshold¬ 
ing).  The  round  trip  is  then  completed  and  the  cycle 
repeats.  The  image  restoration  proceeds  at  a  rate 
governed  by  the  phase-conjugate  resonator’s  response 
time. 

If  the  combination  of  PCM  1  and  PCM  2  has  gain 
comparable  with  the  losses  in  the  system,  the  output 
w  "  ;onverge  to  a  real  image  of  the  complete  stored 
object.  If  a  fixed  hologram  is  used,  many  objects  can 
be  stored  in  the  hologram  by  usii.g  different  reference 
waves.  The  memory  will  then  select  the  stored  object 
that  has  the  largest  correlation  with  the  input  object. 

The  object  and  reference  legs  are  self-aligning  with 
respect  to  the  hologram  because  of  their  phase-conju¬ 
gate  nature.  There  is  an  alignment  requirement,  how- 
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Fig.  2.  Schematic  of  experiment  that  demonstrated  the 
complete  object  image  reconstruction  from  a  partial  input 
image. 

ever,  between  the  input  a,  and  the  stored  object  a,. 
The  translational  alignment  accuracy  required  can  be 
reduced  by  utilizing  a  Fraunhofer  (Fourier-transform) 
hologram.  The  Fourier  transform  of  most  objects  has 
a  large  zero- order  term,  placing  a  large  dynamic  range 
requirement  on  the  hologram  to  avoid  distortions  of 
the  stored  object.  However,  such  distortions  may  be 
desirable  since  the  relative  reduction  of  the  zero-order 
term  will  result  in  the  enhancement  of  high-frequency 
components,  i.e.,  edges,  which  will  help  to  orthogonal- 
ize  the  stored  objects  and  improve  discrimination. 
The  use  of  BaTiO  t  as  a  PCM  also  has  been  shown  to 
provide  edge  enhancement.10 

A  possible  variation  of  the  system  would  be  to  use  a 
spatially  modulated  reference  beam  in  the  formation 
of  the  hologram.  For  example,  the  stored  object  a, 
could  serve  as  its  own  reference  beam  if  a  beam  splitter 
were  employed  i n  t  he  proper  location.  F urthermore,  a 
different  object  could  serve  as  a  reference,  resulting  in 
a  heteroassociative  memory. 

We  have  demonstrated  in  preliminary  experiments 
the  total  reconstruction  of  an  image  when  only  a  par¬ 
tial  image  addressed  the  system.  This  was  done  in  the 
single-pass  configuration  shown  in  Fig.  2,  which  con¬ 
sisted  of  a  single-image  hologram,  acting  as  the  memo¬ 
ry  element,  and  a  nonthresholding  PCM.  The  holo¬ 
gram  was  recorded  at  514.5  nm  using  a  Newport  Cor¬ 
poration  thermoplastic  holographic  camera.  The 
PCM  was  produced  by  degenerate  four-wave  mixing  in 
the  photorefractive  crystal  BaTiO  i.  Typical  parame¬ 
ters  for  PCM  operation  are  wavelength  514.5  nm;  for¬ 
ward  and  backward  pump  fluxes  3.3  and  11.5  W/cmJ, 
respectively;  internal  pump-probe  angle  26°;  and  in¬ 
ternal  angle  of  grating  k  vector  to  c  axis  13°.  The 
hologram  was  generated  by  recording  the  interference 
of  an  object  beam'[a  transparency  of  four  geometrical 
shapes  (Fig.  3A ) j  and  a  spherical  diverging  reference 
beam  at  the  hologram  plane.  On  illumination  of  the 
hologram,  or  of  part  of  it.  by  the  object  beam,  the 
diffracted  beam  propagating  in  the  original  direction 
of  the  reference  beam  becomes  the  probe  beam  for  a 
degenerate  four-wave  mixing  (DFWMt  system.  The 
signal  generated  by  DFWM  is  the  phase  conjugate  of 
the  probe,  i.e..  the  reference  beam  propagating  in  re¬ 
verse.  When  the  DFWM  signal  illuminates  the  holo¬ 
gram  a  portion  of  it  is  diffracted,  recreating  the  object 
beam.  This  recreated  object  beam  has  all  the  inlor- 
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Fig.  -1.  Sc  hematic  of  experiment  that  demonstrated  opera 
tion  of  a  phase-conjugate  resonator  with  multiple  intra- 
cavity  holographic  gratings. 

mation  originally  contained  in  the  input  image.  Thus, 
by  using  the  input  of  a  partial  object  image  (Fig.  .'IBs. 
merely  one  of  the  four  geometrical  shapes,  the  entire 
object  image  of  four  shapes  was  regenerated  (Fig.  30. 
As  expected,  the  system  did  not  reconstruct  the  object 
image  when  the  input  object  was  translated  from  the 
original  position  at  which  the  hologram  was  recorded. 
This  verifies  that  the  complete  output  object  was  in¬ 
deed  generated  by  the  incomplete  input  object  and  not 
by  any  other  beam. 

In  order  to  simulate  thresholding  and  address  the 
issue  of  angular  multiplexing  of  objects,  we  demon¬ 
strated  that  a  phase-conjugate  resonator  can  operate 
with  multiple  intracavity  holographic  gratings  (keep¬ 
ing  in  mind  that  a  hologram  can  be  decomposed  into  a 
set  of  simple  gratings).  The  gratings  were  made  in 
dichromated  gelatin  and  had  a  =  60T  diffraction  effi¬ 
ciency  at  514.5  nm.  The  resonator,  shown  in  Fig  4. 
consisted  of  the  phase  conjugator  (a  pumped  crystal  of 
BaTiO  i  with  a  small-signal  reflectivity  of  25).  an  intra¬ 
cavity  hologram  of  two  superimposed  gratings,  and 
two  output  couplers  normal  to  each  of  the  diffracted 
beams.  The  resonator  could  be  made  to  oscillate  be¬ 
tween  the  conjugator  and  either  output  coupler  by 


adjusting  the  loss  in  either  path.  The  loss  in  either 
leg.  introduced  to  simulate  threshold  behavior,  was 
changed  by  placing  neutral-density  filters  between  the 
output  coupler  and  the  hologram.  By  measuring  the 
power  in  each  leg  it  was  determined  that  in  steady 
state  only  one  leg  oscillated  at  a  time.  This  can  be 
explained  by  the  fact  that  in  the  conjugator  the  two 
resonator  modes  overlap  physically  and  are  competing 
tor  the  same  gain  region.  Therefore  the  mode  with 
less  loss  builds  in  amplitude  at  the  expense  of  the 
other.  In  additional  experiments  we  have  operated  a 
double-PCM  resonator  by  replacing  mirror  1  shown  in 
Fig  4  by  a  second  PCM. 

An  all-optical  associative  memory  employing  a  holo¬ 
gram  in  an  optical  cavity  utilizing  PCM's  has  been 
described  and  initial  experimental  results  presented. 
The  PCM's  provided  nonlinear  feedback,  threshold 
mg.  and  gain,  improving  the  selectivity  and  stability  of 
the  memory.  The  reconstruction  of  an  object  from  a 
partial  input  was  demonstrated.  Using  simple  plane- 
wave  objects,  we  have  shown  that,  by  adjusting  the 
threshold,  either  one  or  both  objects  could  be  made  to 
build  up  in  the  PCM  cavity,  demonstrating  that  the 
memory  is  nonlinear  and  selective.  The  recording 
medium  could  be  replaced  with  real-time  media  such 
as  photorefractive  crystals.  Thicker  recording  media 
have  the  added  advantage  of  higher  angular  selectiv¬ 
ity.  thus  permitting  greater  discrimination  between 
images  and  storage  of  a  larger  data  base. 

We  thank  C.  DeAnda  for  technical  assistance  and  T 
O'Meara.  D  Pepper.  D.  Psaltis.  and  G.  Valley  for  help 
ful  discussions. 
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We  have  in  this  period  demonstrated  associative  recall  from  a 
partial  image  which  has  a  large  gray-scale  range.  We  have  also 
demonstrated  associative  recall  with  two  separate  images  stored 
in  the  hologram.  In  addition  we  have  made  a  preliminary  study  of 
the  analogy  of  our  method  and  model  to  that  of  Hopfield, 
comparing  and  contrasting  the  two.  The  technical  details  of 
these  studies  are  described  in  the  reprints  of  the  several 
presentations  on  this  subject  we  have  given  and  their  abstracts 
are  produced  here . 
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ABSTRACT 

An  associative  holographic  memory  utilizing  phase  conjugate 
mirrors  as  a  nonlinear  feedback  mechnism  is  described. 
Addressing  the  system  by  a  partial  or  distorted  version  of  the 
stored  data  generates  the  complete  version  most  closely 
associated  with  that  input. 
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SUMMARY 


We  propose  to  use  a  hologram  as  a  storage  medium  in  an  al I 
optical  feedback  configuration  which  includes  phase  conjugate 
mirrors.  The  associative  properties  of  holograms  have  been 
suggested  earl ier  bv  Gabor.  Addressing  the  system  by  a  partial 
or  distorted  version  of  the  stored  data  generates  the  complete 
version  most  closely  associated  with  that  input.  The  phase 
conjugate  mirrors  are  used  to  form  an  optical  resonator, 
containing  the  hologram,  with  threshold  adjustment  such  that  only 
the  strongest  reconstructed  image  and  its  correspond i ng  reference 
beam  are  ful ly  reconstructed. 

Because  a  hologram  can  be  decomposed  into  a  set  of  single 
holographic  gratings,  we  demonstrated  that  a  PCR  (phase  conjugate 
resonator)  can  operate  with  multiple  intracavity  gratings.  The 
resonator  consisted  of  the  phase  conj  ugator ,  BaT i 0^ ,  an 
intracavity  hologram  of  two  superimposed  gratings  and  two  output 
couplers  normal  to  each  diffracted  beam.  The  resonator 
osc  i  I  I ates  between  both  output  couplers  unless  there  is  a 
different  loss  in  each  path.  By  adjusting  the  loss  and 
therefore,  the  thresnold,  either  leg  of  the  resonator  could  be 
made  to  osc i  I  I  ate . 

To  replace  permanent  holograms,  the  use  of  photorefractive 
materials  for  real-time  adaptive  associative  memor i es  will  also 
be  presented . 
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Abstract 

An  all-optical  fully  parallel  associative  memory  system  is  described  which  utilizes  a 
holographic  data  base.  Phase  conjugate  mirrors  are  used  to  provide  feedback,  thresholding, 
and  gain.  The  memory  is  compared  to  the  Hopfield  neural  network  model  of  associative 
memory  and  preliminary  experimental  results  are  presented. 

Introduction 


A  large  body  of  research  work  in  the  area  of  neural  network  modeling  has  demonstrated 
the  feasibility  of  associative  memories  based  on  systems  of  distributed  and  interconnected 
memory  elements  with  nonlinear  feedback. 1,5  Such  associative  memories  have  several  useful 
properties  such  as  reconstruction  of  an  output  from  a  partial  input,  heteroassociation,  and 
relative  insensitivity  to  damage  or  modification  of  the  individual  memory  elements  since 
data  are  stored  globally  over  all  the  elements  rather  than  locally.  The  se 1 f -organi z ing 
properties  of  randomly  interconnected  neural  networks  with  connectivity  and  nonlinear 
feedback  have  been  suggested  for  information  processing  applications  such  as  pattern 
recognition,  image  understanding,  and  robotic  vision.  The  ability  to  reconstruct  a 
complete  stored  data  sequence  from  a  partial  or  distorted  input  "key"  may  have  application 
in  rotation  or  scale  invariant  image  processing. 

A  recent  neural  network  model  suggested  by  Hopfield*  has  been  implemented  optically.3 
Optics  is  especially  well  suited  to  implementation  of  such  distributed  associative  memories 
because  of  the  large  degree  of  parallelism  and  interconnection  capability.  Nonlinear 
thresholding,  necessary  for  the  associative  behavior  of  the  Hopfield  model,  was  implemented 
optoelectronical ly  in  Ref  3. 

Close  examination  of  the  Hopfield  model  shows  that  it  is  analogous  in  many  respects  to 
holography,  which  in  itself  has  been  utilized  as  an  associative  memory.4  Input  binary  data 
vectors  are  multiplied  by  an  association  matrix,  T,j,  which  is  formed  from  all  the  stored 
vectors.  This  matrix  represents  a  linear  transformation  and  is  analogous  to  the 
diffraction  of  wavefronts  involved  in  recording  and  reading  an  optical  hologram.  It  will 
be  shown  below  that  the  T, j  transformation  is  similar  to  the  cascaded  correlation  and 
convolution  operations  involved  in  reconstructing  a  wavefront  in  conventional  holography. 
The  additional  features  of  the  Hopfield  model  which  are  lacking  in  conventional  holography 
are  multiple  iterations,  feedback,  and  thresholding  These  features  improve  the  signal-to- 
noise  ratio  and  tend  to  force  the  output  to  one  of  the  stored  states.  The  nonlinearity  of 
an  associative  memory  is  a  key  advantage  over  a  simple  correlator.  It  allows  the 
quantization  of  intermediate  results  when  several  stages  are  cascaded.  The  quantization  of 
intermediate  results  has  been  shown  to  greatly  improve  the  net  s ignal - to-noi se  ratio  of 
cascaded  systems . 4 

Holography  has  potential  advantages  over  optoelectronic  implementations  of  associative 
memories  because  of  its  high  information  storage  capacity  and  an  ability  to  store  three- 
dimensional  wavefronts,  including  both  amplitude  and  phase  information.  In  the  following 
sections  we  discuss  the  similarities  and  differences  between  holography  and  the  Hopfield 
model  In  addition,  it  will  be  shown  that  nonlinear  thresholding,  iterative  behavior, 
feedback,  and  gain  can  be  added  to  a  holographic  memory  by  placing  the  hologram  in  an 
optical  cavity  formed  by  two  phase  conjugate  mirrors  (PCMs) .  Such  a  configuration  combines 
the  advantages  of  holography  (full  all-optical  parallelism  and  high  information  capacity) 
with  the  nonlinear  error  correction  properties  of  associative  neural  nets  such  as  the 
Hop f i e 1 d  mode  1  . 


Analogies  between  holography  and  the  Hopfield  model 

In  the  Hopfield  model,  M  binary  vectors,  v ( *  *  ,  which  are  N  bits  long  are  stored  in  a 
matrix,  T  ,  defined  as  follows: 


Tir  £  (2vi(">'  1)(2Vjm) 


if  i^j,  0  otherwise 
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The  vector  components,  v,  1  *  ">  ,  assume  values  of  1  or  0,  and  the  corresponding  stored 


components  (2vil"l,-l)  assume  values  of  1  or  -1.  If  T,  is  multiplied  by  an  input  which 
a  partial  or  distorted  version,  v1"11 ,  of  one  of  the  stores  binary  vectors,  the  bit. 
l”0>  ,  ls  an  estimate  of  the  stored  bit  (2vil"c,-l)- 


°l®0)=  j-  T  *  (mO) 
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where  N ,  is  the  number  of  ls  in  v  1  ” 
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An  interesting  feature  of  the  Hopfield  model  is  that  the  complement  of  a  stored  vector 
is  also  an  eigenvector  of  the  system  Note  that  for  an  original  stored  vector  N,  is  large 
and  Nb  is  zero,  while  for  its  complement  N,  is  zero  and  Nb  is  large  and  equal  to  the  N, 
value  for  the  original  vector  Both  the  stored  vector  and  its  complement  maximize  the 
absolute  value  of  N,-Nb  and  thus  are  eigenvectors  (stable  states)  of  the  system.  The 
analogue  in  holography  is  that  if  the  wavefront  A  reconstructs  B,  then  by  invoking 
Babinet's  principle  it  can  be  shown  that  1-A,  the  complement  of  A,  will  reconstruct  1  - B , 
the  complement  of  B. 


If  the  diagonal  terms  T ; ;  of  the  association  matrix  are  not  set  equal  to  0,  a  third 
term  appears  in  the  last  equation  which  is  a  reproduction  of  the  partial  input  vector. 

This  term  is  analogous  to  the  zero  order  term  in  holography  which  leaves  the  addressing 
beam  undeflected  and  multiplied  by  the  autocorrelations  of  all  stored  images  and  reference 
beams  In  the  Gabor-type  on-axis  holograms,  the  zero  order  term  is  superimposed  on  the 
image  itself  thus  degrading  its  d i see rnab i 1 i ty .  This  confounding  superposition  would  have 
occured  in  the  Hopfield  model  as  well  if  the  diagonal  terms  had  not  been  eliminated. 


The  Hopfield  model  can  also  be  adapted  for  heteroassociation  by  suitably  modifying  the 
T,j  matrix.  In  heteroassociation  an  input  vector  recalls  a  completely  different  stored 
vector.  The  corresponding  heteroassociati ve  properties  of  holography  are  well  known  and 

4  1  4  5 


routinely  utilized 


The  second  term  in  the  last  line  of  the  last  equation  represents  noise  from  the 
correlation  of  the  input  vector  with  the  undesi red  stored  vectors  The  mean  and  variance 


the  output  can  be  easily  calculated  and  related  to  the  signai-to  noise  ratio  before 


thresholding.  If  it  is  assumed  that  the  vector  components  are  statistically  independent 
and  the  number  of  ls  in  the  stored  vectors  is  approximately  equa,  to  the  number  of  0s 
(expectation  value  of  T  is  0) ,  then  the  mean  and  variance  are  given  by 
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Because  of  the  assumed  statistical  independence  of  tne  vector  components,  all  of  the  terms 
vanish  except  for  m=m '  and  j=j'  so  that 


2  v  -  r  1m)  .,2„  (i!  .  ,  2  ,*  (mO) .  2  - 

a  =  E  -  m*mO(2vi  -1'  '2'j  'vj  >  - 

J*i 

=  '  M  -  1) (N  *  N .  ) 

a  D 

where  E  denotes  expectation  value  and  (N,-NB)  is  the  mean  number  of  Is  in  v  ( " 13  1  .  The 
variance  is  independent  of  tit  position  l.  The  s  l  gnal - to  -  no i se  ratio  before  thresholding 
'which  is  the  same  for  each  of  the  N  cits  of  tne  recalled  vector,'  is  given  by 
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The  above  result  reduces  to  that  in  Ref  2  if  N, -N  2  and  N„=0.  This,  however,  may  not 
always  be  a  good  assumpti:-.  If  the  stored  data  are  nonrandom  and  there  is  some 
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and  is  a  measure  of  the  statistical  correlation  of  pairs  of  bits  within  a  vector  (assumed 
in  the  interest  of  simplicity  to  be  the  same  for  all  stored  vectors)  as  a  function  of  their 
separation,  i.  Statistical  correlation  between  neighboring  bits  results  in  a  nonzero  f , 
Thus  for  "nonrandom"  data  a  new  error  term  appears  which  is  tne  input  vector  convolved  with 
f ,  A  corresponding  expression  can  also  be  calculated  for  t:.«  variance  which  includes  the 
effects  of  statistical  correlation  between  neighboring  bits 

a  2  =  (M  1)  (N  *  N.  )  *  1  (M2  3M  *  3)  51  f 
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The  variance  is  again  independent  of  bit  position  i 
function  of  separation  i-j  only  and  not  position 
amount  and  the  signal  to  noise  ratio  decreased)  oy 
performance  of  the  Hopfieid  model  is  therefore  very- 
stored  data  In  some  applications  such  as  image  st 
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Diffusers  are  often  used  in  holographic  systems  to 
and  improve  the  reconstruction  quality  5 
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Holographic  phase  eon.;  igate  associative  memory 
An  implementation  of  a  nonlinear  associative  memory  cased  on  a  r 


r.o  .  og r  am  s : t  ua • 


cavity  formed  by  two  phase  conjugate  mirrors  ■  PCMs  '  is  illustrates  :  r.  Figure  1  l  r. i  <  e 
another  proposal  for  a  nonlinear  holographic  associative  memory,"  our  implementation 
requires  only  a  single  hologram  which  is  simultaneously  addressee  oy  *.ne  input  *ao  :  r"" 
and  by  reconstructed  object  and  reference  wavefronts  which  were  uses  ;  r.  recording  t 
hologram  PCMs  are  usea  for  beam  retroref  .ec’ior.,  gain,  and  t  r.  res.no  1  :  i  r.g  T.tis  p  r  -  lies 

the  necessary  nonlinearity  which  favors  tte  strongly  correlated  s;gr,a.s  am  forces  *  •  p 
system  toward  a  stable  state.  The  use  of  PCMs  a. so  results  ir.  trie  automatic  self  alignment 
of  the  object  and  reference  wavefronts  *  1 1  ,t  respect  to  the  r.ologran.  eliminating  some  of 
the  critical  alignments  necessary  in  the  two  Pol og ram  approach. 


The  memory  consists  of  a  hologram  in  whirr,  a  stored  or  ect  .  a  is  written,  using  a 
plane  wave  reference,  r  as  illustrated  in  Figure  Multiple  orjeets  are  writ te- 

sequentially  onto  the  r.clogram.  earn  associates  with  a  different  angularly  separate  t  r.a-c. 
wave  reference  T:.“  legs  of  tne  memory  .'cr.sisl  of  a  reference  .  .--g  am:  a-:  o  r  •  t  ,-g. 

eacn  witti  its  respective  PCM  A  partial  cr  aistortea  input  cr;  »f  .  a  generates  ::?•  •  r*  e 
reference  beams.  .  fc  ■  The  wavefront  t*  is  focused  ey  tne  lens  into  PCM  l  PCM  J  -.as  .a 
threshold  tor  conjugation  ana  may.  for  example,  be  a  self  pumped  jc.ctcrefrartive  crystal 
or  a  stimulated  Brillcutr.  scattering  cell.  Since  PCM  1  is  •  r.  the  i’l-.rmr  plane  -f  t 
leris.  the  desired  i  lane  wave  reference  component  of  c  forms  a  :  :  :g..-  v;  c :.  PCV  1  .  r  :  :. 

in  turn  will  threshold  and  conjugate  the  desired  plane  wave  r*--  f  c  ca  x  toward  *  :.*• 

hologram  a?  a  partially  restored  conjugated  reference,  b  7ms  pin-,  ill;,  restore  j 
reference  then  ;  1  1  .s: nates  the  hologram  and  generates  a  part  ial  ly  re«‘ cred  -r;e-*  .  a 

w.nicr.  is  conjugated  ny  PCM  2  bark  to  tne  nologral  PCM  2  d^es  net  *  rr»«t"l  rt  tr.e  ; «  ‘ 

ream  and  oay  cm  sis’  —f  an  externally  pumped  photoref  ract  i  ve  ry  s  •  h  .  7  re  round  •  r  :  :  is 

trier,  reap  let  e  q  ar.u  the  -y:>  repeats  *un  an  improvement  ;r.  tr.e  assc  c  :  at  ea  cutpu*  7- is 
procee  is  at  a  ra’e  g  verned  c>  ‘  he  PCM  cavity  response  time  If  ■  omtur.ej  ga.:  :  ‘:,e 

PCMs  is  -om pnrar.e  *  o  *  r.e  losses  i  r.  the  cavity,  oscillating  wavefronts  will  rut.-,  ur  wr.i-r. 
correspor.  :  to  real  am  v  •  r  tua  1  images  of  tr.e  stored  csjert  r.av.ng  ’r.e  largest  r  r  e  .  a  t  :  or. 
w  :  t  r.  t  r.  e  i  r.  r  u  *  o  n  e  - 

Or.e  advantage  f  tr.is  *>:••  •:  per  1  :  near  assoc  i  at  ;  v«  met.  ■  r  y  over  *  •  e  Ho;  :  1*1".  aci*l  i  = 

tr.at  t  hr  esr.o  1  d  i  r.g  is  acre  on  •  r.e  reference  beam  rather  tr.an  tr.e  or  t  team  The  cutp-t. 
tr.e  re  fore  .  car  be  a  -w  r-  i ;  :» r  >  .  on  a  1  gray-scale  image  unc  :  «>•  r*  «*  s  r  v  t  •  e  r  hreshol  d  s  r.g 
process  Alternatively,  tr.retnolding  can  re  performed  or.  ■  ••  -  r  jet-  team  instead  if  rr  ral 
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for  an  associative  memory.  Therefore,  either  readout  must  be  performed  on  time  scales 
comparable  to  the  cavity  response  time  (before  steady  state  is  reacted!  .  or  means  m.st 
provided  for  modification  of  the  gain  by  the  input  For  example,  a  two-wave  mixing 
pnotoref ract i ve  crystal  operated  in  the  count e rpropagat i ng  mode9  ana  located  in  the 
reference  arm  as  shown  in  Figure  3.  would  impart  a  larger  gam  to  tr.e  stronger  referee 
component  By  proper  orientation  of  the  crystal,  the  reference  component  propagating 
toward  PCM  1  acts  as  a  pump  for  the  conjugated  reference  component  propagating  earn  ’o 
the  hologram  Since  the  two  count erpropagat i ng  reference  components  are  con; u  gates  c  f 
other,  their  overlap  in  the  crystal  is  maxi mi  zed .  wnion  enhances  energy  transfer  cetwpi 
them  Therefore,  the  strongest  reference  *i  1  ,  have  tr.e  largest  gain,  ar.u  its  assr-ut 
stored  object  will  be  favored  to  oscillate  A 1  ’  e  r  r.  a  ’ : ve  1  y  .  're  »*■<■>- wave  mixing  "ry«*a 
could  be  located  in  the  object  arm.  cut  in  this  case  the  readout  oeject  may  oe  distort' 


The  holographic  phase  conjugate  associative  memory  '-ar  nave  gam  m  that  the  cu'ru 
amplitude  can  be  greater  than  the  input.  Therefore,  it  may  ce  possio.e  tea'  several  s 
units  can  be  cascaded  cr  far.nei  out  to  form  more  complicated  "trees"  for  hign.er  crd°r 
computing  such  as  systolic  manipulation  The  error  correcting  rapaoilitv  of  ncr.lir.oar 
associative  sentries  is  necessary  for  such  structures 


Experimental  results 

Our  experimental  arrangement  Figure  4  was  a  single-pass.  nor.  1 1 e r a *  i ve  system 
consisting  of  the  hologram  ana  a  phase  corn  agate  mirror  Tr.e  hologram  was  par*  of  a 
Newport  Ccrroration  thermoplastic  holographic  camera  The  pr.ase  conjugate  mirror  was 
produced  by  degenerate  four  wave  mixing  m.  tr.e  photoref ractive  crystal  BaTi03  The 
hologram  was  generated  by  recording  the  interference  of  ar.  otject  team.  a  sing.® 
transparency  cor."  lstir.g  of  four  geome*  rica.  sr.apes  i  r.  contact  w-.tr.  a  diffuser 
(Figure  5(a';.  and  a  spherical  diverging  reference  ream  I'ror.  illumination  of  tr.e  r. -  1 
by  the  object  beam  lor  part  c:  it, .  the  diffracted  beam  propagating  ir.  the  original 
direction  of  the  reference  beam  becomes  t.ne  probe  ream  for  a  degenerate  four  wave  - :  x  i 
DFWM)  system  The  signal  ger.e-ated  ov  DRAM  is  tr.e  phase  conjugate  of  the  proce  I* 
propagates  back  toward  the  hoi  gram  arc  recreates  the  object  ream  This  recreated  r  • 
beam  has  all  of  t  he  ir.  formation  "rig  i  r.  a  1  1  y  contained  in  tr.e  i  r.p  u*:  image  Therefore,  r 
using  a  partial  input,  one  of  tr.e  geometric  sr.apes  (Figure  5  r  ar.d  tr.e  entire  object 
image  of  four  snares  was  reger.e-n*ea  Figure  3  c)j  As  expe^’-en.  evsjem  aid  r.o* 

reconstruct  the  object  image  w*  .  the  input  object  was  trar.sl  jpi  frotr,  *  he  original 
position  at  which  t.ne  hcicgram  was  recorded.  This  verified  •  at  tn.c  complete  output  c 
was  generated  by  the  incomplete  input  object  and  not  tv  a  =  • •  .  •„•  ream  High  resolu* i  r. 
grayscale  images  have  also  been  reconstructed  using  this  sy.-’-c 


Ir.  or.e  implementation  of  the  associative  memory  multiple  .ejects  are  stored  using 
angular  multiplexing  of  plane  wave  reference  beams  As  a  first  step  toward  multiple  c 
storage,  we  demonstrated  in  another  series  of  experiments  that  a  phase  conjugate  re-  r 
cavity  can  operate  with  a  r.oiogram  formed  with  multiple  plane  wave  oc ; ects  .  Plane  wav 
were  used  to  form  gratings  in  a  d i ch romated  gelatin  hologram  of  approximately  60^ 
diffraction  efficiency  The  resonator,  shown  in  Figure  3.  consisted  of  tne  PCM  eX*  »r 
pumped  BaTiOj  an  »r.t  racav  1 1  v  hologram  of  two  supe  r  i  noosed  gra*  ir.gs.  an  t  wc  u  •  :  .  * 

couplers  normal  •  ea-"h  ?:  the  diffracted  teams  T.ne  re  f ,  ect  i  v  i  '•  y  -t  tr.e  F’CM  was  .  irg 

enougr.  to  overcome  the  optical  losses  sc  operation  was  in  tr.e  regime  v.  tert  t  ‘  j  ‘  R  .  R  -  .s 
greater  h  han  1  Tne  resonator  '•rill  be  made  to  o«c;  1  late  ret  wee  r.  ♦  r.e  r’CV  ar.  1  eit.ter  • 

ccip  .pt  r.  y  n  _•  is’  i  r.  g  •  r,0  loss  ;  r.  e  i  *  n  **  r  r  a 4  h  .  7  r.  e  1  o  s s  .v  a  ^  m  i  r  y  r  .  3  "  : :  1  g  ’  *  .  *  r 
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Figure  3  Gain  modification  using  counter -propagation  in  a  two  wave  mixing  crystal. 
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Fig  ire  4  Schematic  of  an  experiment  which  demonstrated  t.ne  comviete 
image  reconstruction  from  a  partial  input 
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Abstract 


Associative  recall  of  grayscale  holographic  images  with  gain 
and  selectivity  is  demonstrated  using  phase  conjugate  mirrors  for 
thresholding  and  feedback.  Analysis  is  presented  for  both  device 
and  resonator  cavity  thresholding. 


ASSOCIATIVE  HOLOGRAPHIC  MEMORY  WITH  FEEDBACK 


USING  PHASE  CONJUGATE  MIRRORS 
Y  Owechke,  G.  J.  Dunning,  B  H,  Scffer,  and  E.  Marom 

Huqhes  Research  Laboratories 
3011  Mai i bu  Canyon  Road 
Ma I i bu ,  Ca l i fern i a  90265 

Background : 

Associative  memories  and  associative  processing  have  many 
applications  in  symbolic  and  parallel  computing.  Optical 

schemes,  in  particular  those  based  on  holographic  principles,  are 
well  suited  to  associative  processing  because  of  their  high 
paral  lei  ism  and  storage  capacity.  Previous  workers2  have 

demonstrated  that  ho  I ograph i ca I  ly  stored  images  can  be  reca I  lea 
using  relatively  complicated  reference  images.  In  this  paper  we 
describe  the  use  of  phase  conjugate  mirrors  (PCM’s)  to  improve 
the  selectivity  and  performance  of  a  holographic  associative 
memory  by  introducing  gain,  feedback,  and  thresholding. 

Associative  propert i e  s  of  hoi og  rams 

The  formation  of  a  hologram  involves  the  exposure  of  a  I i ght 
sensitive  medium  w > th  two  coherent  wave  amp  I  i tudes  A(u,v)  and 
B(u,v)  generated  by  two  objects  a  and  b.  When  irradiated  by  a 
complex  waver  rent  A  d  (  u  ,  v)  ,  which  is  a  os  to  rted  or  incomplete 
version  of  A  (  u  ,  v  )  ,  the  amplitude  after  the  hologram  is  given  by: 

Ad|A  +  B|2  =  A  d ( ( A | 2  +  | B | 2 )  +  *dAB*+  AdA*B  C1) 

The  last  term  of  this  expression  represents  the 

convolution  of  the  object  b  with  the  correlation  of  ad  and  a. 
For  most  natural  objects  there  is  sufficient  phase  variation  so 
that  if  ad  is  identical,  or  cl ose ,  to  a ,  the i  r  cor  re  I  at i on 
provides  a  sharp  peak  and  b  is  faithfully  reconstructed 

Multiple  objects  b ;  can  be  stored  in  a  hologram,  each 
associated  with  a  different.  reference  wave  a,  This  bv  itself 
acts  as  a  linear  associative  memory,  so  that,  a  distorted  ad  ;  can 
be  represented  as  a  weighted  superposition  of  several  aj  ,  without 
discrimination.  To  display  only  the  object  b  most  closely 
associated  with  a  d  ,  ,  thresholding  is  required  to  pass  only 
a d , a ;  * b ,  .  Another  useful  application  of  an  associative  memory 
is  the  generation  of  a  complete  stored  object  a  from  a  partial 
version  of  the  of  i ec ♦ ,  ad.  It  can  be  shown  that  if  the  last  term 

in  Eg  (1)  is  used  t  readdress  the  hologram,  a  complete  version 

of  a  is  generated  In  the  next  section  it  will  be  shown  that 


PCM  ’s  can  be  used  for  the  readdressing  function  and  in  addition 
provide  gain  for  cascading  associative  modules  and  thresholding 
to  improve  the  selectivity. 


Holographic  implementation 
phase  conjugate  mirrors. 


aisoc i  at i ve 


u  t  i  I  i  z  i  n  < 


The  memory  consists  of  a  hologram  in  which  a  stored  object, 
a  ■  ,  is  written  using  a  plane  wave  reference  b  ;  ,  as  illustrated  in 
Figure  1.  The  two  legs  of  the  memory  consist  of  a  reference  leg 
and  an  object  leg,  each  with  its  respective  PCM.  The  two  PCM’s 
form  a  phase  conjugate  resonator  cavity  with  the  hologram 
determining  the  transverse  mode  structure.  A  partial  or 
distorted  input  object  adi  generates  a  distorted  reference  beam 
bd ; .  The  distorted  reference  bd;  is  focused  by  the  lens  onto 
PCM  1.  PCM  1  is  a  thresholding  conjugator,  e.g.  SBS  or  self 
pumped  photo  refractor.  PCM  1  thresholds  bd ; ,  conjugates,  and 
reflects  it  back  toward  the  hologram  as  a  partial ly  restored 
reference  b;  .  This  partial  ly  restored  reference  then  i  I  I umi nates 
the  hologram  and  generates  a  partial ly  restored  object  a-  which 
is  conjugated  and  reflected  by  PCM  2  back  to  the  hologram 
(without  thresholding).  If  the  initial  gain  exceeds  the  losses, 
the  system  wi  I  I  osc  i  I  late  as  a  resonator.  The  restoration 
proceeds  at  a  rate  governe..  by  the  phase  conjugate  resonator 
response  time.  If  a  fixed  hologram  is  used,  many  objects  can  be 
stored  in  the  hologram  by  using  different  reference  waves  during 
recording.  The  memory  wi  I  I  then  select  the  stored  object  having 
the  largest  correlation  with  the  input  object. 


In  the  above  system  the  net  gains  are  approximately  equal  for 
all  the  stored  objects.  Discrimination  is  a c comp  I  i shed  by 
uti I i z i ng  the  threshold  character i sties  of  the  PCM.  It  is  also 
possible  to  discriminate  between  stored  objects  by  modifying  the 
gain  for  a  particular  obj  ect  according  to  the  input  and  utilizing 
the  cavity  threshold  for  osc i I lation. 


A  possible  variation  of  the  system  would  be  to  use  a 
spatial ly  modulated  reference  beam  in  the  formation  of  the 
hologram.  For  example,  the  stored  object  a-  could  serve  as  its 
own  reference  beam  by  employing  a  beam  sp I itter  in  the  proper 
location.  Furthermore,  a  different  object  could  serve  as  a 
reference,  resulting  in  a  hetero-assoc i at i ve  memory. 


Experimental  results 

We  have  demonstrated 
reconstruction  of  an  image 


in  preliminary  experiments  the  tot a  I 
when  only  a  partial  image  addressed 


the  system.  This  was  done  in  the  single  pass  configuration  shown 
in  Figure  2,  which  consisted  of  a  single  image  hologram,  acting 


as  the  memory  element,  and  a  non  thresholding  phase  conjugate 
mirror  The  hologram  was  recorded  at  5145A  using  a  Newport 
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Corporation  the rmop I ast i c  holographic  camera  The  phase 
conjugate  mirror  was  produced  by  degenerate  four  wave  mixing  in 
the  photoref racti ve  crystal  BaTi03.  The  hologram  was  generated 
by  recording  the  interference  of  an  object  beam,  (a  transparency 
of  four  geometrical  shapes  Figure  3A) ,  and  a  spherical  diverging 
reference  beam  at  the  hologram  plane.  Upon  i  I  lummation  of  the 
hologram  by  the  object  beam,  or  part  of  it,  the  diffracted  beam 
propagating  in  the  original  direction  of  the  reference  beam 
becomes  the  probe  beam  for  a  degenerate  four  wave  mixing  (DFWM) 
system.  The  signal  generated  bv  DFWM  is  the  phase  conjugate  of 
the  probe,  i .e  the  reference  beam  propagating  in  reverse.  When 
the  DFWM  signal  i I luminates  the  hologram  a  portion  of  it  is 
diffracted,  recreating  the  object  beam.  Thus,  using  the  input  of 
a  partial  object  image  (Figure  3B) ,  merely  one  of  the  four 
geometrical  shapes,  the  entire  object  image  of  four  shapes  was 
regenerated  (Figure  3C) .  As  expected,  the  system  did  not 
reconstruct  the  object  image  when  the  input  object  was  translated 
from  the  original  position  at  which  the  hologram  was  recorded . 
This  verifies  that  the  complete  output  object  was  indeed 
generated  by  the  incomplete  input  object  and  not  by  any  other 
beam.  Grayscale  images  with  good  deta i I  have  also  been 
reconstructed  with  this  system. 

Conclusions 

An  all  optical  associative  memory  empl oy i ng  a  hoi ogram  in  an 
optical  cavity  utilizing  phase  conjugate  mirrors  has  been 
described  and  initial  experimental  results  presented.  The  phase 
conjugate  mirrors  provided  nonlinear  feedoack,  thresholding,  and 
ga in,  i mprov i ng  the  se I ect i v i ty  and  stab ■ I i ty  of  the  memory  and 
a  I  lowing  cascading  of  such  associative  modules.  The 
reconstruct i on  of  an  object  from  a  partial  input  was 
demonstrated . 
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Fig.  1 


Implementation  of  an  associative  holographic  memory 
using  phase  conjugate  mirrors. 


Fig  2.  Experiment  which  demonstrated  the  complete  object 
image  reconstruction  from  a  partial  input  image. 

Fig.  3.  Experimental  results:  (A)  image  stored  in  memory; 

(B)  partial  input  image;  (C)  associated  output 
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SUMMARY 

ASSOCIATIVE  MEMORY  IN  A  PHASE  CONJUGATE 
RESONATOR  CAVITY  UTILIZING  A  HOLOGRAM 

Y.  Owechko,  E.Marom,  B.  H.  Soffer,  and  G.  Dunning 
Hughes  Research  Laboratories 
Malibu,  California,  U.  S  A 

An  al  I -optical  ful  ly  para  I  lei  associative  memory  system  is 
described  which  utilizes  a  holographic  data  base.  Phase 
conjugate  mirrors  are  used  to  provide  feedback,  thresholding  and 
memory.  Preliminary  experimental  results  are  presented. 

A  large  body  of  research  work  in  the  area  of  neural  network 
modeling  has  demonstrated  the  feasibility  of  associative  memor i es 
based  on  systems  of  distributed  and  interconnected  memory 
elements  with  nonlinear  feedback.  Such  associative  memor i es  have 
several  useful  properties  including  the  reconstruction  of  an 
output  from  a  partial  input,  heteroassociation,  and  relative 
insensitivity  to  damage  or  modification  of  the  individual  memory 
elements  since  data  are  stored  globally  over  all  the  elements 
rather  than  local ly.  The  se I f-crgan i z i ng  properties  of  randomly 
interconnected  neural  networks  with  connectivity  and  non  I  mear 
feedback  have  been  suggested  for  information  processing 
applications  such  as  pattern  recognition,  image  understanding, 
and  robotic  vision.  The  ability  to  reconstruct  a  complete  stored 
data  sequence  from  a  partial  or  distorted  input  "key"  may  have 
application  in  rotation  or  scale  invariant  image  processing. 

Close  examination  of  the  Hopf i e I d  model  shews  that  it  is 
analogous  in  many  respects  to  holography,  which  in  itself  has 
been  utilized  as  an  associative  memory.  Input  binary  data 
vectors  are  multiplied  by  an  association  matrix  which  is  formed 
from  all  the  stored  vectors.  This  matrix  represents  a  linear 
transformation  and  is  analogous  to  the  diffraction  of  wavefronts 
involved  in  recording  and  reading  an  optical  hologram.  We  show 
that  this  transformation  is  similar  to  the  cascaded  correlation 
and  convolution  operations  involved  in  reconstructing  a  wavefront 
in  conventional  holography.  The  additional  features  of  the 
Hopf i e I d  model  which  are  lacking  in  conventional  holography  are 
multiple  iterations,  feedback,  and  thresholding.  These  features 
improve  the  s I gna I  - to- no i se  ratio  and  tend  to  force  the  output  to 
one  of  the  stored  states.  The  nonlinearity  of  an  associative 
memory  is  a  key  advantage  over  a  simple  correlator.  It  al lows 
the  quantization  of  intermediate  results  when  several  stages  are 
cascaded.  The  quantization  of  intermediate  results  greatly 
improves  the  net  s i gna I -tc-no : se  ratio  of  cascaded  systems. 

Holography  has  potential  advantages  over  optoe I ectron i c 
implementations  of  associative  memories  because  of  its  high 
information  storage  capacity  and  an  ab i I i ty  to  store  three- 
d i mens i ona  wavefronts,  including  both  amplitude  and  phase 
information  We  discuss  the  simi larities  and  differences  between 
holography  and  the  Hopf i e I d  model  In  addition,  we  show  that 


nonlinear  thresholding,  iterative  behavior,  feedback,  and  gain 
can  be  added  to  a  holographic  memory  by  placing  the  hologram  in 
an  optical  cavity  formed  by  two  phase  conjugate  mirrors  (PCMs) . 
Such  a  conf igurat ion  combines  the  advantages  of  holography  (f u  I 
al  I -opt i ca I  para  I  lei  ism  and  h i gn  information  capacity)  with  the 
nonlinear  error  correction  properties  of  associative  neural  nets 
such  as  the  Hopf i e I  a  mode  I  The  use  of  real  time  adaptab 1 e 
memory  employ  mg  photo r e f r a c 1 1 v e  crystals  is  a  1  so  discussed 

We  have  demonstrated  two  key  features  of  an  al I  optical 
associative  memory.  First  we  have  reconstructed  a  complete 
2-d i mens i ona I  gray  scale  image  from  a  partial  input,  and  second 
we  stored  a  pair  of  2-dimensional  images  and  reconstructed  either 
complete  image  from  its  associated  partial  input.  We  use  a 
hologram  as  a  memory  element  in  an  optical  feedback  configuration 
which  utilizes  phase  conjugate  mirrors.  A  hoi ograph i c  memory  I s 
used  because  multiple  gray  scale  images  with  large  space 
bandwidth  products  can  be  stored  by  use  of  angular  multiplexing. 
In  addition  the  information  is  stored  global ly,  and  is  processed 
rapidly  in  parallel.  Phase  conjugate  mirrors  are  used  to  provide 
i-egene  r  a  t  i  v  e  feedback,  optical  gain,  and  thresholding.  In  one 
set  of  experiments  *e  stored  a  2-dimensional  gray  scale  image  of 
a  person’s  face.  We  were  able  to  recall  the  entire  face  by 
addressing  the  system  with  merely  a  portion  of  the  face.  In 
another  set  of  experiments  designed  to  demonstrate  the  system’s 
selectivity  for  multiple  stored  objects,  we  stored  the  two  words 
OPTIC  and  WAVES.  Wren  a  portion  of  either  word  was  input  to  the 
system,  for  example  the  W,  the  entire  word  WAVES  would  appear  at 
the  output  suppressing  the  word  OPTIC.  Conversely  when  merely  a 
single  letter  of  the  word  OPTIC  addressed  the  system,  the 
complete  word  was  produced  at  the  output 
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Hughes  Research  Laboratories 
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ABSTRACT 

An  all  optical  associative  memory  which  incorporates 
holography  and  phase  conjugation  is  described.  We  present 
experimental  results  which  have  reconstructed  2-D  images  wi 
grey  scale  and  high  spatial  frequencies  when  only  a  partial 
was  input  into  the  system. 
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3011  Mai i bu  Canyon  Road 
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SUMMARY 

We  have  demonstrated  an  all  optical  implementation  of  an 
assoc i a t i ve  memory .  An  associative  memo ry  is  a  device  which  when 
addressed  by  a  partial ,  noisy  or  distorted  version  of  the  stored 
data  generates  the  complete  version  most  closely  associated  with 
that  input.  We  have  used  a  hologram  as  a  storage  medium  in  an 
optical  feedback  configuration  which  incorporates  phase  conjugate 
mirrors.  The  hologram  is  capable  of  storing  multiple  images  and 
we  exploit  its  inherent  associative  property.  Furthermore  the 
information  is  s  to  red  globally  and  is  well  suited  to  parallel 
processing.  The  phase  conjugate  mirrors  are  used  to  provide 
regenerative  feedback,  optical  gain  and  thresholding.  We  have 
stored  a  2-D  image  with  grey  scale  and  high  spatial  frequencies 
and  have  been  able  to  reconstruct  the  entire  image  by  inputing 
just  a  portion  of  the  stored  image.  In  additional  experiments  we 
have  demonstrated  the  system  selectivity  when  multiple  plane 
wave  objects  were  stored  in  memory.  By  using  a  resonator 
configuration  and  simulating  threshold  behavior  the  system  was 
able  to  select  and  reconstruct  the  desired  stored  object. 

The  static  recording  medium  used  in  our  experiments  cou I d  be 
replaced  with  real  time  recording  medium.  This  would  all ow  the 
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stored  data  to  be  updated  or  changed  based  upon  the  output.  We 
will  discuss  the  possible  applications  of  the  device  in  various 
areas  of.  artificial  intelligence,  that  is  symbolic  processing  and 

I  present  schemes  which  exhibit  logical 
image  classification. 
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Holographic  Associative  Memory  Employing  Phase  Conjugation 

B  H  Soffer,  E  Marom ,  Y  Owechxo .  ana  G  Dunr.  mg 

Hughes  Research  Laboratories 
Exploratory  Studies  Department 
3011  Malibu  Canyon  Roaa 
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Abstract 

The  principle  of  information  retrieval  by  as  so-- 1  at  i  or.  Mas  been  suggested  as  a  Oasis  •  - 

paral  lei  compu  t  i  ng  an  c  s  the  process  by  whicr.  n  u  man  memory  functions  ‘  Various  as  so  j  .  a  *  .  v 
processors  have  been  p  posed  that  use  electronic  or  optica,  means  Optica*  scr.emes 
particular,  those  bases  on  holographic  principles,5  *  are  we  1  .  suited  to  associative 
processing  because  of  their  high  parallelism  and  information  'hrougnput  Previous  »or<ers 
demonstrated  that  holograph i ca 1 1 y  stored  images  can  De  recall M  ny  using  relatively 
complicated  reference  images  nut  did  not  utilize  nonlinear  feeanac*  *o  reduce  tne  . arg- 
cross  talk  that  results  wner.  multiple  objects  are  stored  and  a  partia.  or  distorted  ::p.'  :> 

used  for  retrieval.  These  earlier  approaches  were  limited  m  tr.eir  anility  to  reconstruct 
the  output  object  faithfully  from  a  partial  input 

Int  roduc  t i on 

We  will  combine  the  principles  of  holographic  memories  and  phase  conju  gat-  ion  • o  imp! eme  n t 
a  novel,  all-optical  nolographic  associative  memory  and  symbolic  processor  An  associative 
memory  performs  image  retrieval  when  partial  or  noisy  image  data  are  input  to  the  device 
The  memory,  a  hologram,  is  capable  of  globally  storing  multiple  t h r ee - d i mens i ona .  3 -D) 

objects.  To  improve  device  performance,  a  nonlinear  interaction  is  oDtained  ny  using  phase 
conjugate  mirrors  (PCMs)  which  provide  retrortf lection .  regenerative  feedback,  thresholding, 
and  amplification  (See  Ref  9  for  a  detailed  discussion  )  By  utilizing  real-time 
holography,  learning  can  be  realized 

We  have  demonstrated  an  associative  memory  capable  of  retrieving  up  to  two  stored  images 
from  memory  This  has  been  achieved  by  using  the  properties  of  phase  conjugation  gain, 
threshold,  and  wavefront  reversal-  PCMs  provide  tne  necessary  nonlinearity  to  favor  the 
strongest  correlation  between  the  partial  or  noisy  input  data  and  the  associated  data  stored 
in  the  hologram 

As  shown  schematically  in  Figure  1,  a  single  hologram  is  simultaneously  addressed  by  the 
object  and  conjugate  reference  beams,  the  latter  acting  as  the  Key  that  unlocKS  tne 
associated  information  The  memory  consists  of  a  hologram  in  which  a  stored  object,  a  .  :? 

written  using  a  plane  wave  reference,  b  The  two  legs  of  tne  memory  cones'  of  a  reference 
leg  to  the  left  of  the  hologram  and  an  object  leg  to  th.e  right  of  the  hologram  Each  leg 
has  its  respective  PCM  A  partial  or  distorted  input  object,  a  generates  a  distorted 
reference  beam  b  This  distorted  reference  beam  is  focused  ny  "re  lens  on'o  a  thresholding 
conjugator,  PCM  1  The  desired  plane  wave  reference  component  becomes  'he  input  to  PCM  1 
PCM  1  will  threshold  this  input  team,  then  conjugate,  ana  reflect  it  tarn  toward  the 
hologram  as  a  partially  restored  reference,  b"  This  partially  restored  reference  then 
addresses  the  hologram  and  generates  a  partially  restored  oeject  The  object  oeam  is 
conjugated  and  reflected  by  PCM  2  bacx  to  the  hologram  (without  t  h.  res  no  1 d i ng  Thresholding 
is  not  done  in  this  leg  because  desirable  information  would  be  lost  if  the  image  contained 
gray-scale  information  The  round  trip  is  then  completed  and  the  cycle  repeats  The  image 
restoration  proceeds  at  a  rate  governed  by  the  phase  conjugate  resonator  response  time 

If  the  combination  of  PCM  1  and  PCM  2  has  gam  comparable  to  the  josses  in  the  system, 
the  output  will  converge  to  a  real  image  of  the  complete  stored  object  By  using  a 
hologram,  many  objects  can  be  stored  in  the  hologram  by  using  different  reference  waves 
The  memory  will  then  select  the  stored  object  having  the  largest  correlation  with  the  input 
object.  The  object  and  reference  legs  are  se i f -ai ign l ng  with  respect  to  the  hologram 
because  of  their  phase  conjugate  nature  There  is  an  alignment  requirement,  however, 
between  the  partial  input  and  the  stored  hologram  The  translational  alignment  accuracy 
required  can  be  reduced  by  utilizing  a  Fraunhofer  (Fourier  transform)  hologram  A  possible 
variation  of  the  system  would  be  to  use  a  spatially  modulated  reference  beam  m  the 
formation  of  the  hologram  For  example,  an  object  could  serve  as  its  own  reference  beam  by 

employing  a  beamsplitter  in  the  proper  location  Furthermore,  a  different  object  couid 
serve  as  a  reference  resulting  m  a  he te roassoc i at l ve  memory 

Presented  at  the  International  Optical  Computing  Conference.  Jerusalem,  Israel,  July  1986 
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Figure  1.  Implementation  of  all-optical  associative  memory 
utilizing  holography  and  phase  conjugation. 


Rented  Experimental  Results 

Preliminary  experiments  have  demonstrated  the  total  reconstruction  of  a  2-D  image  when 
only  a  partial  image  addressed  the  system.  This  was  achieves  using  the  single-pass 
configuration  shown  in  Figure  2,  which  consists  of  a  singi e- image  noiogram  acting  as  the 
memory  element  and  a  nonthresholding  phase  conjugate  mirror.  The  hologram  was  recorded  by 
using  a  thermoplastic  holographic  camera.  The  phase  conjugate  mirror  was  produced  by 
degenerate  four-wave  mixing  in  the  photor e f r act i ve  crystal  BaTiOj  The  hologram  was 
generated  by  recording  the  interference  of  an  object  beam  (a  transparency  is  shown  in 
Figure  3(a)  and  a  reference  beam  at  the  hologram  plane  Upon  illumination  of  the  hologram 
by  the  object  beam,  or  portion  of  it,  the  diffracted  beam  propagating  in  the  original 
direction  of  the  reference  beam  becomes  the  probe  beam  for  a  degenerate  four-wave  mixing 
(DFWM)  phase  conjugate  mirror.  The  signal  generated  by  DFWM  is  the  phase  conjugate  of  the 
probe,  ie. ,  the  reference  beam  propagating  in  reverse  When  the  DFWM  signal  addresses  the 
hologram,  a  portion  of  it  is  diffracted,  recreating  the  object  beam.  This  object  beam  has 
ail  of  the  information  originally  contained  in  the  input  image  Thus,  by  using  the  input  of 
a  partial  object  image  ‘Figure  3(b)  ,  a  portion  of  the  portrait,  the  complete  object  image 

of  the  entire  face  is  regenerated  Figure  3(c)] •  In  order  to  address  the  issue  of  angu  ar 
multiplexing  of  objects,  it  has  been  demonstrated  that  the  device  can  operate  when  two 
images  are  superimposed  on  a  single  hologram  (see  Figure  4)  The  two  words,  OP  an 

WAVES,  were  recorded  by  double  exposing  the  hologram.  Each  was  recorded  with  its  own 
reference  wave.  When  a  portion  of  either  word  was  input  to  the  system  (for  exampie.  >.  e 
the  entire  word  WAVES  would  appear  at  the  output,  suppressing  the  word  OPTIC  Con ve rse i y , 
when  just  a  single  letter  of  the  word  OPTIC  was  input,  the  complete  word  was  produce  at  e 
output.  The  corresponding  experimental  results  are  shown  in  Figure  5 
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Figure  2.  Schematic  of  2-D  image  gray  scale  experiment 
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Figure  3.  Experimental  results  of  2-D  gray-scale  experiment. 

(a)  Image  stored  in  memory.  (b)  Incomplete  input  image 
(c)  Associated  output  image. 
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Figure  4  Schematic  of  mul t i p 1 e - image  experiment. 
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Figure  5.  Experimental  results  of  multiple-experiment  (a)  Multiple 
images  stored  in  memory.  (b)  Partial  input  image. 

(c)  Associated  output  image. 


Initial  experiments  demonstrated  two  key  features  of  an  all-optical  associative  memory 
and  processor.  First,  a  complete  2-D  gray-scale  image  with  high  spatial  frequencies  was 
reconstructed  from  a  partial  input.  In  addition,  system  selectivity  was  demonstrated  for 
multiple  stored  objects  by  storing  a  pair  of  2-D  images  and  reconstructing  either  complete 
image  from  its  associated  partial  input 

In  current  experiments,  we  are  investigating  an  associative  memory  capable  of  storing 
multiple  gray-level  images  in  the  complete  resonator  configuration  with  thresholding.  In 
addition,  we  are  incorporating  real-time  photoref ractive  materials,  e.g.,  LiNbOj ,  as  the 
main  holographic  memory  element. 
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A  more  extensive  analysis  that  that  given  in  the  SPIE  paper 
reproduced  above,  leads  to  the  following  conclusions  regarding 
shift  invariance  and  signal  to  noise.  For  one  dimensional 
objects  (to  compare  with  Hopfield  vectors)  we  find  the  signal  to 
noise  is : 

S/Noise  =  f  \ 

where  N  is  the  number  of  object  resolution  cells  N=w/d  (a  given 
quantity);  maximum  allowed  shift  =  AX=W/2  (minimum  AX=W) ;  AX  is 
the  separation  between  references;  output  window  width  =  AX;  M 
(number  of  objects)^  FOV/AX;  and  f  is  the  fraction  of  the  input 
correlated  with  the  stored  vector. 

For  two  dimensional  objects: 


3  WJL 

2  V  M-l 


(without  nonlinearity) 


S/Noise 


The  result  for  the  1-D  S/Noise  is  approximately  equal  to  that 
derived  in  our  SPIE  paper  for  the  Hopfield  model.  In  the 
Hopfield  model  the  "zero  order  noise"  due  to  the  object 
autocorrelations  is  avoided  by  setting  the  diagonal  terms  equal 
to  zero  T; ; =o  (as  noted  in  our  SPIE  paper) .  In  our  case  we  avoid 
it  by  using  off-axis  references.  We  should  have  superior 
performance  compared  to  Hopfield  for  the  following  reasons: 


2  dimensional  images  with  gray  scale  are  allowed  and 
easily  implemented 

much  larger  N  is  possible 

fully  optical  system 

can  trade  off  between  amount  of  shift  invariance,  number 
of  objects,  and  object  width 


can  have  good  performance  in  many  cases  in  single  pass 
configuration  without  thresholding  due  to  the 
correlation  properties  of  random  phase  diffusers. 


We  have  made  an  analysis  of  the  fundamental  storage  capacity 
of  the  Holographic  Associative  Memory  using  Ewald  Sphere 
constructions.  This  analysis  concentrated  upon  the  limits  due  to 
the  wave  nature  of  light  and  the  finite  dimensions  of  the 
hologram  and  neglected  the  material  effects  of  saturation, 
reciprocity  failure,  grain  noise.  Some  of  these  effects,  such  as 
the  MTF  of  hologram  medium,  were  included  however.  A  typical 
result  for  a  thin  hologram,  assuming  an  object  with  50  cycles/mm 
maximum  frequency,  \=0.5  fim  and  a  reference  beam  angle  excursion 
of  23®,  is  that  10  holograms  can  be  stored.  For  a  thick  hologram 
(100  /i m)  ,  assuming  the  same  parameters  as  above,  approximately 
100  objects  could  be  stored.  There  is  a  trade-off  in  the  thin 
hologram  case  between  the  number  of  objects  stored  and  the  degree 
of  translational  invariance  that  can  be  enjoyed. 

Lastly  work  was  begun  to  implement  psuedo  conjugation  using 
liquid  crystal  light  valves  to  replace  the  phase  conjugation  of 
BaTi03  four-wave  mixing  as  presently  employed.  The  use  of  psuedo 
conjugation  is  possible  in  this  application  because  our  reference 
waves  are  plane  waves  or  waves  simply  derivable  from  a  point 
source.  The  possible  advantage  of  using  such  a  scheme  .ould  be 
speed  of  operation  and  elimination  of  the  critical  alignment  of 
many  laser  pump  beams,  as  well  as  the  reduction  in  the  power 
requirements  of  the  laser  source. 

B.  INTENSITY  TO  POSITION  MAPPING  SPATIAL  LIGHT  MODULATORS 

The  variable  grating  mode  liquid  crystal  phenomena  and 
device,  conceived  and  developed  in  this  AFOSR  program,  in  its 
present  state  of  development  has  too  slow  a  response  time 
(typically  tens  of  milliseconds  rise  time  and  hundreds  of 
milliseconds  decay  time)  to  be  of  practical  interest  for  many 
applications.  We  have  been  examining  alternative  means  to 
provide  the  very  attractive  processing  function  of  mapping 
spatially  variant  object  intensity  patterns  to  position  in  an 


extended  Fourier  space  containing  object  intensity  as  an 
additional  parameter.  Earlier  in  this  program  we  had  conceived 
and  implemented  a  device  based  on  the  refraction  of  light  by  an 
array  of  liquid  crystal  prisms  whose  index  of  refraction  would  be 
locally  modulated  by  the  local  intensity  of  object  light  falling 
on  an  underlying  photoconduct ive  layer.  This  device  also  proved 
to  be  too  slow  and  the  deflections  too  nonuniform  for  practical 
application  because  of  the  need  to  employ  thick  liquid  crystal 
prisms  with  very  nonuniform  field  distributions. 

In  this  period  we  have  begun  to  examine  a  variation  of  this 
scheme.  Instead  of  an  actual  array  of  physical  prisms,  a  set  of 
interd igi tated  electrodes  on  a  thin  uniform  liquid  crystal  layer, 
again  sitting  atop  a  photoconductor  layer,  form  a  set  of  virtual 
prisms  by  voltage  induced  index  gradients  whose  strength  depends 
upon  the  local  object  light  intensity  falling  upon  the 
photoconductor.  The  deflection  that  can  be  achieved,  in  either 
device,  depends  only  upon  the  maximum  phase  excursion  in  the 
liquid  crystal.  The  gradient  index  device  is  expected  to  perform 
better  because  of  more  uniform  field  distributions  across  each 
pixel.  This  work  is  in  progress. 
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